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ABSTRACT 

A discussion of testing in 
Engl i sh-as-a-Second-Language (ESL) instruction focuses on the gap 
between ESL s tudents 1 test performance on the one hand and thei r own 
and teachers' assessments of their competence on the other. First, a 
number of issues, drawn from the literature, are examined briefly, 
including the appropriateness of current testing methods, the 
teacher's role in evaluation, and variation in learners' test-taking 
strategies and skills that affect evaluation. Three ways to improve 
ESL student evaluation are explored: (1) clarification of evaluation 
criteria and use of criterion- vs. norm-referenced tests; (2) student 
participation in the assessment process, through self-monitoring and 
peer evaluation; and (3) improved use of technology, both to tailor 
test items to the learner's level and to provide useful feedback. 
Contains 36 references. (MSE) 
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Bridging the Evaluation Gap in ESL 
Introduction 

An essential component in the design of the ESL curriculum, whether 
^ notional-functional, skill-based or content-based, is assessment of 

oo the learners' academic and social needs ( Dubin and Olshtain 1986:25; 

eg Krahnke 1987:75; Katz 1988:178). These needs cannot be fully met 

8 without the proper evaluation of the learners. Students feel 

Q motivated when their evaluation gives them a sense of fairness and 

acceptablity. 

However, there is often a wide gap between the students' 
performance on tests and their perceived competence. The gap is 
further widened by the difference between the teacher's evaluation 
and the one based on standard tests. While some ESL programs have 
partly recognized the learners' needs by adding a testing course, no 
serious attempt has been made to address the evaluation gap. 

Aim and Scope 

The aim of this article is first, to examine test techniques, strategies 
and evaluation procedures in ESL, and second, to suggest how these 
can be effectively integrated into the ESL program to bridge the 
evaluation gap. For the learners to achieve an accurate perception of 
their performance level, techniques such as self-monitoring and 
regular peer feedback are described. While the testing system is 
scrutinized, the thrust of the article is to help the learner function 
within the current system. The discussion will focus on the learners 
as active participants and on the teacher's role to guide them to take 
full responsibility for their learning and performance (Kabonen 
1992:36). 



Basic Terms 

To clarify the discussion, the basic terms should be first explained. 
Evaluation, as used here, refers to the interpretation of student 
performance on tests with due attention to test characteristics and 
individual needs and goals. Assessment is measurement that is 
often used as the first step toward evaluation. Tests are to be 
distinguished from exercises and examinations in. that they are 
designed to measure specific skills utilizing established formats such 
as multiple choice and the cloze procedure. A criterion-referenced 
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test "measures a student's performance according to a particular 
standard or criterion" whereas a norm-referenced test shows how 
the student's performance compares with that of another group used 
as the norm. (J.D. Brown 1993:168). The literature refers to test 
writers, test users and test takers. 

Other distinctions to be kept in mind include achievement vs. 
proficiency and, from the learner's perspective, grade vs. score. The 
definition of proficiency varies from one writer to another. It 
ranges from "the ability to communicate accurately" along a 
continuum( Lowe & Stansfield 1988:13 ) to obtaining a specific score 
on a proficiency test ( Jones 1981:107). 

Relating Modern Methodology to Testing and Evaluation 
Although testing is an integral part of the learning process, methods 
of testing and evaluation have not kept up with the changes in 
learning methods and approaches. Very often testing is treated as a 
separate field with little or no reference to the reactions or 
psychology of the learner (Buck 1994:147). The emphasis seems to 
be more on the statistical procedures than on the learners' benefits 
(James 1981:43). 

Criticism is usually aimed at the structure or content of tests rather 
than the procedure of evaluation . For example, Gattegno, in 
defending the Silent Way, feels that "...we rarely focus upon our 
students' actual progress and instead measure their distance from a 
pre-established end where they 'should be' presumably because of 
our means and approaches" ( 1978: 201). He advocates what he calls 
"continuous feedback, the backbone of correct assessment and 
evaluation" (p. 199). 

Another learning approach advocate, Wilkins, suggests a different 
method of testing. He explains (1976:82) that in the Notional 
approach 

...we will be seeking the answer to the question of whether the 
learner can express such things as concepts of time, spatial 
relationships, possibilities, intentions, promises, forgiveness, 
prohibitions, affirmations, conjectures, surprises, solicitude - 
indeed any of the sub-categories that are proposed for the 
notional syllabus. 
He, however, admits that at the time of writing his book " we do not 
know how to establish the communicative proficiency of the 
learner" . 



ERIC 



2 

3 



Neither Gattegno nor Wilkins deals specifically with the evaluation 
procedure and that is probably true of many other advocates of 
modern teaching approaches. At the same time, we find a great deal 
about the need to adopt modern learning methods which usually 
emphasize two major chare teristics, namely individualization and 
collaborative learning. 

The learning process has beer described as participatory, 
communicative, cooperative, experiential and interactive. According 
to Nunan (1992:4), one of the three areas of collaborative learning is 
progress monitoring and evaluation tasks. But as far as the actual 
testing and evaluation procedures are concerned, there is still a gap 
rather than collaboration between the learners and the teachers. 

The gap is further widened by the diversity among the learners who 
vary in their perception of their level of competence; some lack 
confidence and some are overconfident. They also vary in their test- 
wiseness, skills, motivation, level of anxiety and general attitude 
toward testing. In some cases, when they see the vast difference 
between the tests and the class activities, they tend to look for short 
cuts such as studying mainly for the test or even cheating in some 
situations. 

The Role of the Teacher 

The teacher, on the other hand, in trying to encourage the students 
may give "generous" grades or evaluations regardless of the learners' 
actual performance. Grades are partly based on classroom 
considerations such as attendance, participation and test results 
(Heilenman 1990: 188). 

This situation is further complicated by the difference between the 
teacher-made tests that are based on a specific textbook and 
standard tests such as TOEFL and Michigan. From the perspective of 
ESL students, grades roughly stand for the teacher's evaluation 
whereas scores are ultimately the basis for the Admissions officer's 
evaluation. The students are usually aware of the admission policy in 
many institutions to reduce evaluation to a single score such as 500 
or 550 on the TOEFL (Thomas 1994:328). 

In this system, where students do not understand the evaluation 
procedures, let alone taking part in them, they become teacher- 
dependent and that may seriously affect their motivation and 
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in the evaluation process. 

This is a process that requires both individualized and cooperative 
SSt students and teT^and 

plateau (Spolsky 1990:12). 

SScwed so as to allow participation within the learners zone of 
personal development" to use Vygotsky's terms (Mohan & Smith 
1992:98). 

riMriv the role of the teacher is quite challenging. It involves 
SSg^tog eacmng and testing, exposing the ™s to a vm«y of 

formats and providing the proper interpretation of test results. 
A^oSe^rSpSmty is facilitating feedback and interaction to 
Sate to leZer? effective strategies while they are involved in 
self- and peer-evaluation. 

1% S£d£SS5 and educational background^ the 
learners axe bound to vary in their styles, strategies and skills which 
tffrrt rheh- oerformance on tests. Some are recognized as slow 
WneS and sonTaVfasf learners. Then there are those that tend to 
b whhTothers tend to be holistic and commumcative- 
orieStedS 1990:94) Furthermore, teachers often distinguish 
her^Len tose who rely heavily on memory and those who prefer 
mo£ : socS «°es considered typical of specific national groups 
such as the Middle Easterns, Asians and Hispamcs. 
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It has also been observed that successful learners are likely to use a 
variety of strategies and the advanced ones to use more task- 
relevant strategies (Oxford 1990:104). By identifying the students' 
individual strategies, the teacher can take the first step toward 
helping them to cultivate effective strategies. In this respect, the 
weaker students can benefit from the teacher's explanations and 
from their peers' feedback. 

As far as test-taking is concerned, some students are skilled in test- 
wiseness (TW) which is defined as " the ability to use test-taking 
strategies to select the correct response in multiple-choice tests, 
without necessarily knowing the content or using the skill that is 
being tested " (Allan 1992:121). For example, in a test of TW, as 
opposed to 'normal' strategies, the choice may be based on 
eliminating obviously incorrect alternatives and looking for 
grammatical clues or a pattern of answers. In some cases, students 
show a tendency "to respond to factors other than question content" 
known as "response effects" (Heilenman 1990:175). According to 
Allan, "taking a test of TW [for which he provides an example in 
Appendix B pp.1 14-1 19] and receiving feedback might be enough to 
sensitize learners to the use of unfamiliar test-taking strategies" 
(Allan 1992:110). 

Test-taking strategies may be considered in relation to the specific 
language areas such as listening comprehension, speaking, reading 
and writing. But there are basic strategies that ESL students should 
be trained to develop from the beginning. Among these are following 
directions, speed and careful timing. For those who always complain 
about lack of time, practice can help. Moreover, familiarity with the 
various formats of tests and types of questions in the various 
language areas should be useful. 

Test Practice and Evaluation Criteria 
Adequate practice on different test types and formats should be 
provided so as to include, for example, multiple-choice, true-false, 
matching checklists, completion and the cloze procedure. In the 
choice of test types, attention should be paid to the advantages of 
criterion-referenced tests as compared with norm-referenced tests 
(J.D. Brown 1993). Here the role of the teacher is crucial in explaining 
the value and limitations of test types to the students before 
interpreting the results as part of the evaluation procedure. 



In the clarification of evaluation criteria, a great deal can be learnt 
from the manuals and guidelines for such tests as TSE (Test of 
Spoken English, TWE (Test of Written English) and TOEFL. According 
to Lowe & Stansfield (1988:3) the most comprehensive guidelines 
combine those of ETS, ACTFL and ILR (Interagency Language 
Roundtable) . Interviews can be videotaped and evaluated by 
students to the extent possible in the light of the appropriate TSE 
criteria. Similarly, students can discuss their writing (organization 
and ideas) based on the TWE six-point scale. It is important to be 
aware of the complexity of the factors involved and the need to 
understand the bases for judgment ( Douglas 1994). To participate in 
proper evaluation a certain amount of training is obviously 
necessary. 

Self- evaluation and Feedback 

As indicated earlier, to bridge the evaluation gap the students must 
be guided to participate in the evaluation process both individually 
and as a group. Instead of the traditional practice where the teacher 
knows best or as Stevick put it "Now try to do this so I can tell you 
how you did " (Quoted by Haughton and Dickinson 1988:234), the 
idea is to become self-directed and responsible for one's learning and 
performance on tests. 

There are several reasons for self-evaluation. As already mentioned, 
it is a step toward an accurate perception of one's ability. 
Furthermore, it is not only a "necessary part of self-direction", but 
also "one way of alleviating the assessment burden on the teacher" 
(Dickinson 1987:136). 

But the question is sometimes raised regarding the accuracy and 
reliability of self-evaluation. While some studies show a significant 
correlation between self-assessment and objective assessment, 
others indicate little or no correlation. Others still believe that both 
self-evaluation and external evaluation complement each other (de 
Bot 1992:138). 

The process of self-evaluation entails adopting techniques for self- 
monitoring in every language area (Oscarson 1989). These include 
self-reports, diaries, questionnaires, checklists and charts. In reading, 
for example, charts may be kept by the student to show progress in 
speed, comprehension and vocabulary. To evaluate their writing, the 
students may discuss in small groups criteria for organization and 
cohesion similar to those used in TWE as already pointed out. Along 
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the same lines, suggestions based on TSE may be used for evaluation. 
While general standard tests cannot be reviewed, samples may be 
carefully studied. 

Feedback from students can significantly enhance the process of 
evaluation. Students in small groups may discuss the performance of 
individual members in the light of criteria and relevant information 
provided by the teacher. As part of the feedback process, students 
record their reactions to tests indicating how they respond, the level 
of difficulty and what they like or dislike about the questions. 

Such feedback may be provided through questionnaires and short 
questions along a 5-point scale. Comments can indicate the students' 
view in terms of fairness and acceptability (A. Brown 1993:278-9). 
Besides, the mere attention to student comments is likely to be 
motivating and, as Madsen et al. (1991: 66) point out, "reflects an 
interest in the total process and not simply in the intellect or skill 
mastery". 

This participation in the evaluation process has additional 
advantages. Apart from enabling the students to achieve a more 
accurate perception of their performance level and enhancing their 
motivation, it can reduce their anxiety level. Excessive test anxiety 
can be debilitating especially as the degree of anxiety usually 
increases with the degree of evaluation perceived (Daly 1991:9). 

The Role of Technology 

Modern technology can help facilitate the process of testing and 
evaluation. Two promising areas are the latent trait theory or item 
response theory (IRT) and computerized adaptive testing (CAT). IRT 
assumes according to Tung "an accurately calibrated set of items that 
assess a single dimension of the examinee's ability" (Tung 1986:27). 
The difficulty and discrimination power of an item vary according to 
the level of the examinee. IRT has been known since 1986 but it was 
only after its application in CAT that it became valuable (Stansfield 
1986:5). Thus it was possible to tailor test items to the examinee's 
level. Although CAT has its limitations in dealing with complex 
communicative activities, it may be used in diagnostic testing of such 
discrete areas as vocabulary and sentence structure. 

Furthermore, computers can be a valuable tool in providing 
immediate feedback regarding progress evaluation with accuracy 
and speed (Carroll & Halll985:135).. They can provide regular 
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reports that the student may discuss with other students and with 
the teacher (J.D. Brown 1993:180-181). As a result, through 
computer-assisted testing, which lends itself to individualized work, 
self-evaluations with actual performances may be compared and the 
information shared by learners and teachers. Such information has 
implications for the "learners' perceptions of their 
abilities"(Alderson 1990:26). 

Conclusion 

Bridging the evaluation gap in ESL involves individualized as well as 
cooperative work. Three major areas are considered, namely guided 
test practice, self -evaluation and feedback. In their practice on 
various types of tests, the students are encouraged to learn from 
each other and cultivate effective strategies. 

As a counselor or facilitator, the teacher structures the class activities 
so as to integrate testing and evaluation into the program. The 
learners are provided with the opportunity to be active participants 
in the evaluation process guided by discussion, explanations and peer 
feedback. Not only will the process reduce their test anxiety and 
enhance their attitude and motivation, but it will also help them 
achieve a more accurate perception of their abilities. 

Further research is needed to assess the impact of changes in the 
evaluation procedure on bridging the gap. Self-evaluation may be 
compared with the teacher's evaluation and examined in light of 
student feedback. 
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